A STOCHASTIC APPROXIMATION FOR FULLY NONLINEAR FREE 

BOUNDARY PROBLEMS 
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Abstract. We present a stochastic numerical method for solving fully non-linear free boundary 
problems of parabolic type and provide a rate of convergence under reasonable conditions on the 
non-linearity. 

1. Introduction 

Option pricing problems, e.g. basket options, are generally several dimensional. In such cases, 
deterministic methods, e.g. finite difference, are almost intractable because the complexity increases 
exponentially with the dimension and one almost inevitably needs to use Monte-Carlo simulations. 
Moreover, most other problems in finance, e.g. pricing in incomplete markets and portfolio optimiza- 
tion, lead to fully non-linear PDEs. Only very recently has there been some significant development 
in numerically solving these non-linear PDEs, see e.g. [8], [20] . [7], [17j and [12]. When the control 
problem also contains a stopper, e.g. in determining the super hedging price of an American option, 
see [13], or solving controller-and-stopper games, see [5], the non-linear PDEs have free boundaries. 

For solving linear PDEs with free boundaries, i.e. in the problem of American options, Longstaff- 
Shwartz [T6], introduced a stochastic method in which American options are approximated by 
Bermudan options and least squares approximation is used for doing the backward induction. The 
major feature in [IB] is the tractability of the implementation for the scheme proposed in terms of 
the CPU time in high dimensional problems. The most important feature of this model that facili- 
tates the speed is that the number of paths simulated is fixed. Simulating the paths corresponds to 
introducing a stochastic mesh for the space dimension and the Bermudan approximation to Amer- 
ican options corresponds to time discretization. Stochastic mesh makes sure that the one considers 
the more important points in the state space are used in the computation of the value function, an 
important feature which increases the speed of convergence. So essentially, this algorithm can be 
thought of as an explicit finite difference scheme with stochastic mesh. One can in fact prove the 
convergence rate of the entire "stochastic" explicit finite difference scheme, see [9] for a survey of 
these results and some improvements to the original methodology of Longstaff-Shwartz. 

For semi-linear free boundary problems a similar stochastic scheme is given through Reflected 
Backward Stochastic Differential Equations (RBSDE) in [IT] and rate of convergence is derived to 
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be /i^/^ assuming uniform ellipticity for the problem where h the mesh size of the time discretizaton. 



(Here the number of paths, N, that one needs to simulate increase with decreasing h and needs 
to be chosen in a certain way, see e.g. (j3.15p . This is similar to what we have in classical explicit 
finite difference schemes. To achieve stability, when we decrease the mesh size for time, we need to 
decrease the mesh size for the space variable. As we discussed above, the Monte-Carlo simulation 
creates a stochastic mesh.) The first result in this direction is due to [T7]. Later [7] improved the 
result of [T7] by removing the uniform ellipticity condition. Moreover, they improve the rate of 
convergence to /iV2 by assuming more regularity on the obstacle function. 

In this paper, we generalize the Longstaff-Schwartz methodology for numerically solving a large 
class of fully non-linear free boundary problems and show the rate of convergence of this scheme. 
The idea used here relies on the stochastic scheme in [12], which considers fully non-linear Cauchy 
problems. The proof of convergence follows the methodology of [T] with slight modifications due to 
the free boundary. Under an additional assumption, a rate of convergence is obtained using Krylov's 
method of shaking coefficients together with the switching system approximation as in [6], where a 
rate of approximation is obtained for classical finite difference schemes for elliptic problems with free 
boundaries. An appendix is provided to establish the comparison, existence and regularity results 
for a parabolic switching system with free boundary which is needed to provide the estimations in 
the rate of convergence proof. It is worth mentioning that a convergence result for classical finite 
difference schemes for fully nonlinear free boundary problems is provided in [19] and |18| . 

The rest of the paper is organized as follows: In Section [21 we present the stochastic numerical 
scheme. In Section O we present the main results, the convergence rate, and its proof. The 
Appendix is devoted to the analysis of non- linear switching systems with obstacles, which is an 
essential ingredient in the proof of our main result. 

Notation. For scalars a, & G M, we write a A 6 := min{a, b}, and a\/ b := max{a, b}. By M(n, d), 
we denote the collection of all n x d matrices with real entries. The collection of all symmetric 
matrices of size d is denoted S^, and its subset of nonnegative symmetric matrices is denoted by 
S^. For a matrix A G Wl{n,d), we denote by its transpose. For A,B(^ Wl{n,d), we denote 
A ■ B := TrlA'^B]. In particular, for d = I, A and B are vectors of and A • B reduces to the 
Euclidean scalar product. For a suitably smooth function ip on Qt := (0, T] X M*^, we define 



Finally, by Kt^x we mean the conditional expectation given Xt = x for a pre-specified diffusion 
process X. 



oo 




2. Discretization 



We consider the obstacle problem 



mm 



v-F {■,v,Dv,D'^v) 





v = g, on {T} x R' 



d 



(2.2) 
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where 

:= ^+^^.Dip + ^a-D^ip, 

and 

F : {t,x,r,p,-f) eM+ X O xRxR'^ xSd i — > F(x, r,p, 7) G M, 

is a non-linear map, /i and a are maps from M4. x O to M"' and M((i, d), respectively, a := aa'^ , 
g : [0, T) X M'^ — M. We consider an M'^-valued Brownian motion 1^ on a filtered probability space 
(ri, F, P), where the filtration F = {J^t,}te[o,T] satisfies the usual conditions, and J-q is trivial. 
For a positive integer n, let h := T/n, ti = ih, i = 0, ...,n, and consider the one step Euler 
discretization 

■.= x + f,{t,x)h + ait,x)iWt+h-Wt), (2.3) 

of the diffusion X corresponding to the linear operator . Then the Euler discretization of the 
process X is defined by: 

We suggest the following approximation of the value function v 

v^{T,x) := g{T,x) and v''{ti,x) := max{Th[v'']{ti,x),g{ti,x)} for any x G R"^, (2.4) 
where for a given test function : denote 

ThMt^x) ■=^t,x [i'{t + h,Xt+h)] +hF{;Vhi^){t,x), (2.5) 

Vhi'iti^x) = Et^^\i;{t + h,Xt+h)Hh\, (2.6) 



where Hh = (Hk,H'^,H!})'^ and 



Remark 2.1. The reasoning behind ()2.6p can be found in Lemma 2.1 in |12j . 



3. ASYMPTOTICS OF THE DISCRETE-TIME APPROXIMATION 

In this section, we present the convergence and the rate of convergence result for the scheme 
introduced in (j2.4p . and the assumptions needed for these results. 

3.1. The main results. The proof of the convergence follow the general methodology of Barles 
and Souganidis [1], and requires that the nonlinear PDE ()2.ip satisfies the comparison principle in 
viscosity sense. 

We recall that an upper-semicontinuous (resp. lower-semicontinuous) function y_ (resp. U) on 
[0, T] X M'^, is called a viscosity subsolution (resp. supersolution) of (12. ip if for any (i, x) G [0, T] x R'^ 
and any smooth function ip satisfying 



= (v — ip){t, x) = max {v_ — <p) \ resp. = (f — ip){t, x) = min {v — , 
[0,T]xM'' V [0,T]xRd 
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we have: 

• if t < T and X G M'^ 

mm\^— C'^if — F{t,x,'D(p{t,x)),(f — < (resp. >) 0, 

• iit = T,v — g<0 (resp. v — g > 0). 

Remark 3.1. Note that the above definition is not symmetric for sub and supersolutions. More 
precisely, for a subsolution we need to have either 

-C^if - F{t, X, V(p{t, x)) <0oT ip-g< 0. 

However, for a supersolutions we need to have both 

-C^ip - F{t, X, Vip{t, x)) > and 99 - 5 > 0. 

Definition 3.2. We say that (j2.ip has comparison for hounded functions if for any hounded upper 
semicontinuous subsolution v and any bounded lower semicontinuous supersolution v on [0, T) x M"^, 
satisfying v{T, •) < v{T, ■), we have v<v. 

We denote by Fj., Fp and F^ the partial gradients of F with respect to r, p and 7, respectively. 
We also denote by F~ the pseudo-inverse of the non-negative symmetric matrix F^ . 
Assumption F (i) The nonlinearity F is Lip schitz- continuous with respect to {x,r,p,j) uniformly 
in t, and •, 0, 0, 0)|oo < K for some positive constant K; 

(ii) F is elliptic and dominated by the diffusion of the linear operator , i.e. 

VyF < a on M'^ x M x M'' x S^; (3.1) 

(iii) Fp E Image(F^) and \F:^F-Fp\^ < K; 

(iv) Fr - \fJf~Fp > 0. 

Remark 3.3. Assumption F(iv) is made for the sake of simplicity of the presentation. It implies 
the monotonicity of the above scheme. If this assumption is not made, one can carry out the 
analysis in \12\ Remark 3.13, Theorem 3.12, and Lemma 3.19] and approximate the solution of the 
non-monotone scheme with the solution of an appropriate monotone scheme. 

Theorem 3.4 (Convergence). Suppose that Assumption F holds, that \fi\i + \a\i < 00, and that a is 
invertihle. Also, assume that the fully nonlinear PDF (|2.ip has comparison for hounded functions. 
Then for every hounded function g Lipschitz on x and ^ — Holder on t, there exists a bounded function 
V such that — > v locally uniformly. Moreover, v is the unique bounded viscosity solution of 
problem (^-([Tlh. 

By imposing the following stronger assumption, we are able to derive a rate of convergence for 
the fully non-linear PDE. 
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Assumption HJB The nonlinearity F satisfies Assumption F (ii)-(iii), and is of the Hamilton- 
Jacobi- Bellman type: 

l-a--f + b-p + F{t,x,r,p,j) = inf x, r,p, 7)}, 

C'^it,x,r,p,j) := ^rrKcj"T(t,a;)7] +6"(t,x)p + c°(t,x)r + r(t,x), 

where the functions fi, a , , 6°, c° and satisfy: 

lAi|oo + k|oo + sup(|a"|i + |6"|i + |c"|i + |r|i) < 00. 
aeA 

Assumption HJB+ The nonlinearity F satisfies HJB, and for any 5 > 0, there exists a finite 
set {ai}^\ such that for any a £ A 

inf |a"-a"'|oo + |6"-6"'|oo + |c"-c'^'|oo + ir-r'|oo < S. 

l<i<Ms 

Remark 3.5. Assumption HJB+ is satisfied if ^ is a compact separable topological space and 
(t"(-), c"(-) and /°(-) are continuous maps from A to C^' , the space of bounded maps which 

are Lipschitz in x and ^-Holder in t. 

Theorem 3.6 (Rate of Convergence). Assume that the final condition g is bounded Lipschitz on x 
and ^ — Holder on t. Then, there is a constant C > such that: 

(i) under Assumption HJB, we have v — < Ch^^^ , 

(ii) under the stronger condition HJB+, we also have —Ch^^^^ < f — . 

It is worth mentioning that in the finite difference literature, the rate of convergence is usually 
stated in terms of the discretization in the space variable, i.e. |Aa;|, and the time step, i.e. |At| 
equals |Aa;p. In our context, the stochastic numerical scheme (j2.4p is only discretized in time with 
time step h. Therefore, the rates of convergence in Theorem 13.61 corresponds to the rates |Ax|^/^ 
and jAxI^/^, respectively. 

3.2. Proof of the convergence result. The proof Theorem 13.41 similar to the proof of Theorem 
3.6 in |12] . is based on the result of [1] which requires the scheme to be consistent, monotone and 
stable. Notice that from Lemmas 3.11, 3.12, and 3.14 in [12], we already know the consistency, 
monotonicity and stability for the scheme without obstacle, i.e., Th satisfies 

• Let 93 be a smooth function with bounded derivatives. Then for all (t, x) G [0, T] x W^: 

V [c+^]{t',x')-Th[c + ^]{t',x') , X n n2 \\ 1, ^ 

hm = -[L If + F{-,ip,Dip,D if)) {t,x). 

{t' ,x') ^ {t, x) n 

{h,c) -> (0,0) 
t' + h<T 

• Let tp : [0, T] x R'^ — > M. be two bounded functions. Then: 

f<i^ =^ Th[if]{t,x) <Thmt,x). 
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• If (? is bounded, the family {v^)h defined by 

v^{T,x)=g{T,x) and v''{ti,x) = Th[v'']{U,x) 

is bounded, uniformly in h. 

In the next result, we will show that {v^)h is also bounded, uniformly in h, i.e., this sequence of 
functions is stable in the sense of [1]. 

Lemma 3.7. The family {v^)h defined by (|2.4p is bounded, uniformly in h. 

Proof. Due to the monotonicity of T/^, we already have that < v^. Let Ci = {ti, ■)\oo- By 
the argument in the proof of Lemma 3.14 in [12], \Th[v'^]{ti, •)|oo < ^4+1(1 + Ch) + Ch. Therefore, 

Ci < maxjlgloo, Ci+i(l + Ch) + Ch} < max{C7i+i, I^UKl + Ch) + Ch. 

Using a backward induction one could obtain that Ci < Ce^'^ for some constant C independent of 
h. a 
Let us define 

v^:{t, x) := liminf liminf inf{t;'^(t, y) : \x — y \ + \s — t\ < 5,s £ {0,h, - ■ ■} D [0, T]}, and 

h (3-2) 
v*{t, x) := limsuplimsup sup{v {t, y) : \x — y\ + \s — t\ < 6, s £ {0, h, ■ ■ ■ } H [0, T]}. 

We are going to prove that v* and i;* are respectively sub and supersolutions of (|2.ip - (j2.2p . We 
first provide the argument for v* at an interior point {tQ,xo) € [0,T) x M'^. We will present the 
subsolution property at to = T separately. 

Assume that v*{tQ,xo) > g{to,XQ), otherwise v*{tQ,XQ) = g{tQ,xo) and the subsolution property 
is readily satisfied. Let (p he a smooth function such that 

0= max {v* - (p) = {v* - (l)){to,xo), 

[0, T] X R"* 

and that at {tQ,xo) is global strict maximum is attained. (Here, we can assume that the global 
maximum is attained at our given point without loss of generality, thanks to Lemma 13.71 ) Let 
{tn,Xn) be the global maximum of v^" — (j). The fact that {tQ^xo) is a global maximum oi v* — cj) 
imply that there exists a subsequence, which we still denote by {tn, Xn) such that Xn) — )• {tQ^xo) 

and V^'^{tn,Xn) V*{tQ,XQ). 

Let '■= uiayi{v^" —cj)). Since t''*" < the monotonicity of T/j,^ implies that T^,Jf^"](t„, x^) < 

^hn[4> + iri\{tn-,Xn). Observe that by v*{tQ,XQ) > g(tQ,XQ), one can deduce that for large n, 
v^"{tn,Xn) > g{tn,Xn) holds true. Therefore, 

V^-{tn,Xn) =ThAv^"]{in,Xn) < T,,„ [0 + X^). 
Because v''"{tn,Xn) = (/)(t„,X„) +S,n, 

4>{tn,Xn) +in- T,,„ [0 + X„) < 0. 

Dividing by /i„ and taking the limit as n — t- oo, the consistency of the scheme implies that 

- + F(-, D^, dV)) (to, xo) < 0. 
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To prove that f* is a supersolution, we need to show that that v^{t,x) > g{t,x) and —C^ip — 
F(t,x,'D(p{t,x)) > holds in the viscosity sense. Let i;^ be a smooth function such that 

= min (u* - (p) = (u* - (p){to,xo), 

[0, T] X K"* 

and the {tQ,XQ) is a global strict minimum point (again this is as above without loss of generality). 
Therefore, there exists a sequence {{tn,Xn)}, such that {tn,Xn) — )• {to,xo), v^'^{tn,Xn) — )• v*{tQ,xo), 

'■= min(f^" — (p) = {v^" — (j)){tn-,Xn) — 7" 0, and {tn,Xn) is a global minimum of v^'^ — (f>. 
Therefore, v'^^ > </> + By monotonicity of the scheme, Th^[v'^"]{tn,Xn) > T/i„[(/> + x„). 
Therefore, by the definition of in (|2.4p . 

v''"{tn,Xn)>ThJv''-]{tn,Xn)>ThJ(l) + U{tn,Xn). 

Because x„) = (/){tn,Xn) + 

[0 + in]{tn-,Xn) > 0. 

Dividing by and taking the limit as — )• oo, we obtain 

- + F(-, 99, D^, (io, xo) > 0. 

If to = observe that by monotonicity of T, < v^. Therefore, by Lemma 3.17 in |12j . 

g(T,xo) = liminf v^(t',x') < f*(T, xq), 

(h,t',x')^{0,T,xo) 

which completes the proof of the supersolution argument. 

Finally, the following Lemma shows that v*{T,-) = g{T,-) which completes the subsolution argu- 
ment. 

Lemma 3.8. \v^iti,x) - g{T,x)\ < C{T -U)^. 

Proof. By replacing the stopping time in the Lemma 3.11 |llj by a new stopping time defined by 
f := vava.{tj\v^{tj,Xtj) = g{tj,Xtj)}, it follows that there is a positive constant C such that 

\v^{tu x) - g{ti,x)\ < CyjT - ti. 

Then, the result follows from ^-Holder continuity of g with respect to t. □ 

3.3. Derivation of the rate of convergence. The proof of Theorem 13.61 is based on Barles 
and Jakobsen [3] , which uses switching systems approximation and the Krylov method of shaking 
coefficients [13] • This has been adapted to classical finite difference schemes for elliptic obstacle 
problems (free boundary) problems in [6]. In order to use the method, we need to introduce a 
comparison principle for the scheme which we will undertake next. 

Proposition 3.9. Let Assumption F hold and set /3 := |-Fr|oo- Consider two arbitrary bounded 
functions ip and tp satisfying: 

mm.[h~^ {lp -Th[^p\) - g] < gi and min {h~'^ {ip - Th[ip]) ,ip - g} > 52 (3.3) 
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for some bounded functions gi and g2- Then, for every i = 0, - ■ ■ ,n: 

{^-m^,^) < e'^(^-*>)(|((^-v)+(r,-)|oo + (i + (r-t.))l(5i-52)+|oo). (3.4) 

Proof. We may assume without loss of generality that 

^{T, •) < ^(T, •) and gi < 52- 

Otherwise, one may take tp^t^x) = ip{t,x) + S{t), where 

Sit) = e^^^-'^ - ^)+(r, .)|oo + (1 + (T - 0)1(51 - 52)+|oo) . 

Then, by Lemma 3.21 in |12j . 

/i-i (^ - Tfc[^]) >/i~'(^-Tfc[^]) + |(5i-52) + |oo >5iV52. 

On the other hand, by the definition of ■ip and 5, ^ — g > 92 + I (51 — 52)^ 1 00 > S'l V (72. Therefore, 

mm{h-^^P-Th['>p]) ,11}- g} > 51V 52. 

Now, we proceed by induction. We assume that for some i, ip{ti + /i, •) < ip(ti + /i, •). 
Case 1. If, 

min {h~^ {if - Th[ip]) , if - g} {ti,x) = h~'^ {if - Th[ip]) {ti,x), 

then, since 

mm{h-^{tl;-Thm,^P-g}{ti,x) < h^^ {ip - Th[ip]) {t^, x), 

we have {ip — Th[ip\) {ti,x) < h^^ {ip — Th[ip]) {ti, x). Due to monotonicity of T/j, we can deduce 

that ip{ti,x) < 'ip{ti,x). 

Case 2. If, on the other hand, 

mm{h~^{ip-Th[(p]),(p-g}{ti,x) = {^p - g){ti, x), 

then, we have 

mm{h-^{tl;-Thm,ip-g}{t^,x) < {^P - g){t^,x), 

we have ip{ti,x) < ip{ti,x). □ 

3.3.1. Proof of Theorem \ 3.6\ (i). Under Assumption HJB, we can build a bounded subsolution v'^ 
of the nonlinear PDE, by the method of shaking the coefficients, see [3], [6], |15j . and the references 
therein. More precisely, consider the following equation 

mini-£^i;- inf F (t - s,x + y,v, Dv, D'^v) ,v - g\ = 0, on [0, T) x M'^, (3.5) 

[ 0<s<e2,|j/|<e J 

V = g, on {T} x W^. (3.6) 

By Theorem IA.51 there exists a unique bounded solution , in the class of function with at most 
linear growth, to (|3.5p - (|3.6p . This solution, due to Theorem IA.6l is also Lipschitz in x, 1/2— Holder 
continuous in t. It is not hard to see that v'^ is a subsolution to (I2.ip -( |2?2]l and by Theorem IA.3I 
approximates v uniformly, i.e., there exists a positive constant C such that v — Ce < < v. 
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Let p{t,x) be a C°° positive function supported in {{t,x) : t G [0, 1], \x\ < 1} with unit mass, and 
define 

1 f t x\ 

w'^{t,x) := v'^ * p'^ where p'^ {t, x) := —rprp ( - ] . (3.7) 



It foUows that \w'^ — v\ < Ce. From the convexity of the operator —F and the fact that G C°°, 
is a classical subsolution of p.ip on U := { (t, x) \ g{t — s,x + y) < v^{t — s,x + y); for any s G 
[0, e^) and \y\ < e}, see e.g. the Appendix in Moreover, since is Lipschitz in x and 1/2— Holder 
continuous in t, it follows that 



< for any (/3o, /5) G N x N"' \ {0}, (3. 



where |/3|i := Pi, and C > is some constant. As a consequence of the consistency of T^, see 
Lemma 3.11 in [12], we know that 

TZh[w']{t,x) := ^"(t^^)-^h[w%t,x) ^ c''w%t,x) + F{;w',Dw\D^w'){t,x)<Che-\ 

From this estimate together with the subsolution property of w'', we see that w'^ < T h[w^] + C h'^ 
holds true on U. In addition, by the regularity properties of g, one can see that w'^ < g + Ce on 
[0, T] X \ U. Therefore, 

. f w'{t,x)-Th[w%t,x) , X^r^r ^ -3m 
mm < ,w —g><Ci[e + e h). 

Then, it follows from Proposition 13.91 that 

-v^ < C\{w' - v^){T, .)|oo +Ci{e + he-^) < C{e + he^^). (3.9) 

Therefore, v — < v — + — < C{e + he^^). Minimizing the right hand-side estimate over 
e > 0, we obtain v - < Ch^^^. □ 

3.3.2. Proof of Theorem \3.6\ (ii). To prove the lower bound on the rate of convergence, we will use 
Assumption HJB+ and build a switching system approximation to the solution of the nonlinear 
obstacle problem (j2.ip - ()2.2p . This proof method has been used for Cauchy problems in ^ and [12] . 
For obstacle problems, this method is used in the elliptic case by [6] for the classical finite difference 
schemes. We apply this methodology for parabolic obstacle problems to prove the lower bound for 
the convergence rate of our stochastic finite difference scheme. We split the proof into the following 
steps: 

(1) Approximating the solution to (|2.ip - (j2.2p by a switching system, which relies on Theo- 
rem IA.31 the continuous dependence result for switching systems with obstacle. 

(2) Building an almost everywhere smooth supersolution to ()2.ip - ()2.2p using the mollification 
of the solution to the switching system. 

(3) Using Proposition 13.91 the comparison principle for the scheme, to bound the difference 
of the supersolution obtained in Step 2 and the approximate solution obtained from the 
scheme. 
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Step 1. Consider the following switching system: 



mm < max i—v^ sup 

I I 0<s<e^,\y\<e 



— C''^v^''{--s,-+y),v'''-M'^'^v^\ ,v^'' -g\{t,x) = 0, (3.10) 



v''\T,.) = g{T,.), (3.11) 



where = {v'^''^)fLi, M^'^^v^ = minj:jyj{f^'-' + k}, k is a non-negative constant, aj's, for i = 
1, • • • ,M, are as in assumption HJB-|-, and C°''(p := ^Tr [a"'*{t,x)D'^ip] + b"^ {t, x)D{p + c"^ {t, x)lp + 

r{t,x). 

By Theorem lA. 51 the viscosity solution v'^ to (|3.10p - ()3.1ip exists and by Theorem lA. 61 is Lipschitz 
continuous on x and ^-Holder continuous on t. Moreover, by using Assumption HJB-|-, Theorem 
IA.3I and Remark lA.H one can approximate the solution to (j2.ip - ()2.2p by the solution to (j3.10p - 
(13. lip , see Theorem 3.4 [6] and the proof of Theorem 2.3 in [3] for more details. More precisely, 
there exists a positive constant C such that 

\v-v^^'\oo < C{e + kl). 

Step 2. Let Vs^'^ := v^'* * p^, where {/O^} is as in p.7p . As in Lemma 4.2 in [6] and Lemma 
3.4 in [3] for e < ( 12supj |fe*^|i ) k, the almost everywhere smooth function Ws := minvi^^ is a 



supersolution to 

- C^v - F (•, V, Dv, D'^v) > 0. (3.12) 
Moreover, for any {t,x) G [0,T) x W^, if iq E argminue*^(t, x), we have vi^°\t,x) < vi^\t,x) + k. 

i 

Therefore, for all i we have 

{we-v){t,x) = (v(^o) -v){t,x) < {v^'°^ -v^^){t,x) + (u« -v){t,x) < k + C{e + k^). 

(i) 

Choosing k = Ci£ with Ci = 12 sup j |ue |i, one can write 

{we-v){t,x) <Ce^. (3.13) 

Step 3. Notice that Ws is almost everywhere smooth and therefore, the subsolution property holds 
true almost everywhere in classic sense. Moreover, since (j3.8p is almost everywhere satisfied by tu^, 
one can conclude that 

nh[ws]it,x) := ^e{t,x)-Th[ws]{t,x) ^ c''wS,x) + F{.,w,,Dwe,D'we){t,x)>-ChE-^ 

therefore due to (j3.12p . '^e(*'^)~'^ft["'eK*.^) > _(^/j^-3 j^glds true almost everywhere. By Proposition 
13. 9| one can get 

(v^ -w'){t,x) <Che-^. (3.14) 

Now, (fXT3]) and (fmp yields 

{v^-v){t,x) < C{e^ +e-^h). 
By minimizing on e > 0, the desired lower bound is obtained. □ 



11 



Remark 3.10 (Stochastic scheme). Scheme (j2.4p produces a deterministic approximate solution. 
However, in practice, we approximate the expectations in (12. Sp based on a randomly generated 
set of sample paths of the process X. As a result, the approximate solution is not deterministic 
anymore. By following the line of argument in Section 4 in |12j . one can show the almost sure 
convergence of this stochastic approximate solution and even provide the same rate of convergence 
in hP{n,F). 

More precisely, assume that E is approximated by where N denotes the number of sample 
paths. Suppose that for some p > 1, there exist constants Ci,, X,v > such that ]E^[i?] — K[R] < 

V 

Chh~^ N~'^ for a suitable class of random variables R bounded by h. By replacing E with E^ in the 
scheme (|2.4p . one obtains a stochastic approximate solution v^. Then, if we choose = which 
is chosen to satisfy lim/j_j.o -/V^/i^"*"^ = oo, then under assumptions of Theorem 13.41 

v%^{-,u}) — > V locally uniformly, 

for almost every co where v is the unique viscosity solution of (j2.ip - ()2.2p . In addition, if 

lim N^h^+TT, > 0, (3.15) 

we have that \\v — v'^^Wp < Ch^^^^, under the assumptions of Theorem 13. 6[ 

A. Appendix: A switching system with an obstacle 

In this section, we will provide some results needed in the Section [3.31 In particular, we present a 
continuous dependence result for the switching system with obstacle and as a corollary a comparison 
result, which provides the uniqueness of the solution. Then, the existence and regularity of the 
solutions to the switching systems are provided. 

Consider the following system of PDEs for v = {v^^^)fLi: 

mm imax \ -vf^ - Fi{-,v^'\ Dv^^ , D^v^^),v'^^ - M'^^v} ,v'^'^ - g] = 0, for i = 1, • • • , M; 

J J (A.l) 

7;»(T,.) = g(T,-). 



We also need to consider a variant of equation (jA.ip as follows: 
min|max|-vf^ -Fi(-,z;W,£)z;(^),D2^W),'y(*) - A^^^^z;} , i;^ - 5} = 0, for i = 1, • • • , M; 

^;«(r,.)=5(T,-)- 

Assumption HJB-S. We assume that in (jA.ip and ()A.2p 



(A.2) 



Fi{-,v^'\Dv^'\D\^''^) = inf n^''^ and Fi{-,v^'\ Dv^'\ D\^'^) = inf (A.3) 
J^My = minj.j-/,i{vj + k}, k is a non-negative constant, and 

£^'Xx) := ^Tr [af (t, x)I)V] + Kit, ^)D^ + «?(*, x)^ + /f (i, x), 
r-Xx) ■.= \Tr [ant, x)D''ip] +hf{t,x)Dip + c^t^x)^ + f^{t,x). 
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Moreover, 

L := \g\i + |5|i + sup + |6"|i + |c"|i + |r |i + |<7"|i + + |c"|i + \hi) < oo, 

and for all a G IJi have cf >0 and cf > 0. 

Remark A.l. For the sake of simplicity in Assumption HJB-S, we only included the nonlinearities 
of infinum type. However, all the results of this appendix still hold if we assume that 

F,{-,v'^^,Dv^\d'^v^^)= inf supT'"'^ and Fi{-,v^\Dv'^^ ,D'^v^^) = inf sup i!''"'^, (A.4) 



\9\i + \9\i+ sup + \bT\ + Icf'^li + \ft\ + + \bT'\i + Iq'^li + \ft\) < oo, 

and for all a G Uj-^* ^'^^ ^ U/'^*) '"'^ /iflue c"''^ > and c"''^ > 0. This remark is also valid if 
we change the order of inf and sup in (]A.4p . 

Lemma A. 2. Let u = and v = {v^^^)i he respectively the upper semicontinuous subsolution 

and the lower semicontinuous supersolution of (jA.ip and ()A.2p . and assume that ip{t,x,y) is a 
smooth function bounded from below. Define 



V'(^) {t, X, y) = n« {t, x) - {t, y) - ip{t, x, y) 
Ji ■■= |j 
J2{t,x) := {i| u^^\t,x) <g{t,x)^ 



3{t',x',y') : sup i;^'\t,x,y) = i;^^\t' ,x' ,y') \ , 



Suppose that there exists an (^q, ioi a^o, yo) such that supj^^ .j. ^ 2;, y) = ip^'^'o\tQ,xo,yQ)and J\ n 

Ji^Q:^^ = 0- r/ien, t/iere exists an zq sttcft t/iai 'i/''^*°^(io5 2:0, yo) = V'^*''H^O) 2:0, yo) o'^c? 

Moreover, if in a neighborhood of {tQ,XQ,yQ) there are some continuous functions hQ{t,x,y), h{t,x) 
and h{t, y) such that 



D'^ip{t,x,y) < ho{t,x,y) 



I -I 
-I I 



+ 



h{t,x) 
hit,y) 



then there are a, 6 G M and A, y G S!^ such that 
a-b = ipt{to,xo,yo), 
( ^ j < 2/io(to,2;o,yo) f 



-/ / 



+ 



h{to,xo) 
Kto,yo) 
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-a+ inf \lT:t[al{to,xo)X] +bl{to,xo)DMto,xo,yo) + c^{to,xo)u^'°\to,xo) + ft,{to,xo < 



-^0 



(A.5) 



b+ inf l^Tr [al{to,yo)Y] +bl{to,yo){-Dy^{to,xo,yo)) + Sl^{to,yo)v^'^^ 



> 



(A.6) 



Proof. The first part of the proof is similar to those of Lemma A. 2 in [2], Lemma A.l in [6]. The 
second part follows as a result of Theorem 2.2 in [TU]. □ 
The following theorem on continuous dependence is used in Section 13.3.21 and in the regularity 
result, Theorem I A . 61 below. Intuitively speaking, continuous dependence result asserts that a slight 
change in the coefficients of (jA.ip changes the solution only slightly. 

Theorem A. 3 (Continuous dependence). Let HJB-S hold. Suppose that u = and v = 

{v^^^)i are a bounded upper semicontinuous subsolution of (jA.ip and a bounded lower semicontinuous 
supersolution of (|A.2p . respectively. Then, for any i = 1, • • • , A^, 

_ ^» <13:= Cmax||(<7 - g){; OU + Tsup - + (|n|oo V bloo)!^^'" - c'^u} 

+ VTsup {id^-'^ - a^'^loo + l?^'" - ^'■'"loo} [. 



Proof. Let (p{t,x,y) = e^C^"*)! |x - + e^C^"*) 2^(|a;p+T + |y|2+7) and define 

V := sup {n(*)(t,x) - - ip{t,x,y) - ^| , 

t,i,x,y ^ 

where e,e,9 > are arbitrary constants and constants A and 7 > will be determined later in the 
proof. We will show that T> is bounded by a constant B{e,e,6) which converges to the bound B 
mentioned in the theorem as {£,e,0) — t- (0,0, 00). From the latter it would follow that 

u(^) {t, x) - v^^^ {t,x)<V + ^ + e^(^-*) < B{e, e, 6) + - + e^^"*) 

t 2+7 t 2+7 

Sending e, e — )• and 9 ^ 00 one would then obtain 

u^''^{t,x) -v^'\t,x) < B, for t > 0. 

Note that the above inequality is also valid for t = by considering [—6, T] as the time interval by 
changing T to T + 5. 
Define 

^» {t,x,y) = n« {t,x)- ^» it,y)-^{t,x,y)- - \ , 

where a = 1) — ax with ax = supj ,^ ,^ {u^^^{T,x) — v^'^\T,y) — ip(T,x,y) — ■ Let 

V := sup ip'''\t,x,y). (A.7) 

i,t,x,y 
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Since u^*) and f are bounded, we have P < oo. On the other hand, by semicontinuity of u^*-* 
and v^^\ one can conclude that the supremum in the definition of P is attained at some point 
{io,tQ, xo,yo). In other words, Ji / (see Lemma fA. 21 for the definition of J'l). 
If (T < 0, then T> < GT- Since 

e 



o-T < \g - g\oo + sr^v{\a\i\x - y\- <f{T,x,y)] 



x,y T 



< b - 9\oo + sup{|5f|i|x - y\ - - yp} < \g - + 

one can conclude that < \g — g\ac + ^f^- Therefore, we may assume that cr > 0. From the 
definition of V, we have to > 0. On the other hand, a > implies to < T. Because if to = T, then 
o"T ^ ^ which implies 

o" a 

<7T > - — > 0"T + — > (TT 

which is a contradiction. So, we have < Iq < T. We continue the proof by considering two 
different cases. 

Case 1: J'l n i72(to,a^o) 7^ 0- The supremum in ()A.7p is attained at some point (io, to, a^O) yo) with 
n(*)(to,xo) < g{to,xo) and ?;W(to,yo) > g(to,yo)- Therefore, 

^ < g(to, xo) - g{to,yo) - ip{to,xo,yo) - ^ ^"^^ - |- 

ZI to 

< b - 5loo + \g\i\xo - Vol - ^\xo - yop < Is- - g\oo + 

On the other hand, since P<P + f<P + i(P - cjt) < ^ + I'D, we have P < b - + 
Case 2: Ji n .72(to, 2;o) = 0- By Lemma lA?2l there exists a, 6 G M and X, y e such that 



a- 6 = -A(/7(to,xo,?/o) - - 4, (A. 9) 



and (jA.Sp . ()A.6p hold. Using Assumption HJB-S and (|A.8p . one can write 

Tr [a"'^«(to,xo)X-a°'^°(to,yo)l'] 

< 2e^(^-*o)0Tr [K'^°(to, ^o) - <T"'^°(to, yo))'] + ee^(^-*°)(|xor + l^oDCTr [a"'^°(to, xo)) + a"'^°(to, t 

< Cie^(^-*°) (0|xo - yoP + - '^"'^IL + ^(1 + kol + |yol)'+^)) , 

< C2e^(^-*°) (e|xo - yoP + ^Ift"''" - 6"'*°|ooko - ?/o| + e(l + |xo| + |yol)'+^)) , 

and 

r'^«(to,xo) - r''nio,2/o) < c^i\xo - yo\ + ir''» - r-^ioo). 
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Observe that since < a < D < + ^, we have < T> which imphes u^^'^\tQ,xo) — w^*°^(io,yo) > 0. 
Because c"'* > 0, 

c°'^''(io,yo)>(to,yo) - c°'^°(io,xo)n'°(to,xo) < Cgdn^U V |^»|oo)(|c"'*° - c"'^«|oo + \xo - yo\). 
Subtracting ()A.6P from (jA.SP and using the estimates above, we obtain 

A(^(to,xo,yo) + ^<c(e\xo-yo\'' + - <t"''°|L 

+ - fo"''loo|xo - yol + e{l + \xo\ + |yo|)'+^ 

+ (|n«|oo V |^«|oo)(|c"'*° - c"'*o|oo + \xo - yo\) 

_|_ |yQ,2o _ JQ^,«0 I 

where C = maxjCi, C2, C3, C4}. On the other hand, since ar < \g — g\oo + one can conclude 
from (jA.lOp . which gives an upper bound on a, that 

V < a + aT<\g-9\oo+^-^-2XT^{to,xo,yo) + CT(^e\xo-yo\^ 

+ (|tX«|oo V b«|oo)(|c"''» - C°'*°|oo + |X0 - yol) + ir-*" - 



1 00 



Choosing A large enough and maximizing with respect to |xo — yo 

|2 



26 y 



00 



Now maximizing with respect to yields the desired result. □ 
The following result in a straightforward consequence of Theorem IA.31 and will be used to 
establish the existence and the regularity of the solution to (jA.ip . 

Corollary A. 4. Assume t/iat HJB-S holds. Suppose thatu = {u^^^)i andv = are respectively 

a bounded upper semicontinuous subsolution and a bounded lower semicontinuous supersolution of 
(|AT]) . Then, for any i = 1, • • • ,N, < . 

Theorem A. 5 (Existence). Assume that HJB-S holds. Then there exists a unique continuous 
viscosity solution in the class of bounded functions to (jA.ip . 

Proof. We follow Perron's method (see e.g. Section 4 in [1^). Observe that by Assumption 
HJB-S, u = —K and v = K are respectively sub and supersolutions of (jA.ip for a suitable choice 
of positive constant K. Define v^'^\t,x) := supju^*^ (t, x) ; u is a subsolution to (jA.ip } and 

v^^^*{t, x) := limsupsup{t;(s, y) : \x — y\ + \s — t\ < 6, s €^ [0, T]}, 
<5^>0 
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and 

,(0 



{t, x) := liminf inf{v{s, y) : \x — y\ + \s — t\ < (5, s G [0, T]}. 

5->o 



It is straight forward that -K < vi'' < u^*)* < K. We want to show that {v^''-'>*)fli and {vi'')fi^ 
are respectively a sub and a supersolution to (jA.ip which by comparison, Corohary IA.41 yields the 
desired result. 

Step 1: Subsolution property of We start by showing that {U, ■ ■ ■ ,U) with 

U{t, x) := ae{T - t) + g{T, z) + \g\i {T - t + \x - z\^ + e) ^ 

is a supersolution to ()A.ip for a suitable positive constant a^. Observe that since 

U{t, x) - g{t, x) > g{T, z) - g{t, x) + \g\i {T - t + \x - zf + e) ^ > 0, 

we have that U{t,x) > g{t,x), and in particular U{T,x) > g{T,x). On the other hand, by simple 
calculations, one can show that, for an appropriate choice of «£, we have —Ut— inf^g^i C^'^U > 0. 

Therefore, by comparison, Corollarv IA.41 for any subsolution u, u < U which implies v^^^* < U; 
specially v^^^*{T,x) < U{T,x). Sending e — )• and setting x = z, f^*^*(T, x) < g{T,x). 

Now, for fixed i, we suppose t < T and f is a test function such that 

= max {v^'> -^} = {v^^* - 'p){t,x). 
[0,T]xR<* 

It follows from the definition of v*-*^* that there exists a sequence {{un,tn,Xn)}n with tn < T such 
that Un is a subsolution to (|A.ip . {tn,Xn) — )• {t,x), Un\tn,Xn) — )• v^^^*{t,x), and (t„,rE„) is the 
global strict maximum of Un^ — if. Let 5„ := maxp 2-]xiRd{iin^ — By the subsolution property of 
Un, we have 

min jmax |-93t - inf^ + Sn),u^^'^ - M^'Kr^j ,<f + dn-g^ (tn, x„) < 0. 

Because A^^*^n„ < M^^^v* , by sending n — ?■ oo, 

min|max|-99t - inf ^ - A^^t;* | , - g^ {t,x) < 0. 

Step 2: Supersolution property of vi^\ Since (17, • • • , 17) is a subsolution to (jA.ip . vi^\t,x) > 
g{t,x). In particular, vi^\T,x) > g[T,x). Therefore, we only need to show that 



max 



-{vi'^)t - inf C'''v^,v^ -M^'hA> 0, (A. 11) 



on [0,r) X in the viscosity sense. We will prove (jA.lip by a contradiction argument. Assume 
that there are a test function ip and {i, t, x) with t < T such that (i, x) is the global strict minimum 
of vi^^ — if and max {— (/Jt — ini^^j^i C^'"ip, (^9 — {t, x) < 0. Then, by continuity of (p and the 

equation and lower semicontinuity of v*, one can find e > and 5 > small enough, such that for 
F ~ ?/| + I'S ~ ^1 < S we have that ip + e < vy and that 

max|-((^ + e)i- inf £^'"(99 + e), ((^ + e) - A^»t>,\ (s, y) < 0. (A.12) 
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Define 

(i), . I ioaax{(p + e,v^^^*}{s,y), j = i and \x - y\ + \s - t\ < 6; 

w^-"{s,y) := < ,., 

I v^^'*{s,y), otherwise. 

Since v* is a subsolution to (jA.ip and by ()A.12p . one can show that it; is a subsolution to (jA.ip . 
By the definition of vi^\ we must have vi^^ > w^^\ which contradicts with the fact that w^^^tjx) = 
ip{t, x) + e < vi^'\t, x) for \x — y\ + \s — t\ < 6. □ 

Theorem A. 6 (Regularity). Assume that HJB-S holds. Let (u^)^^ he the solution to (jA.ip . 
Then, {u^^^)f£-^ is Lipschitz continuous with respect to x and ^-Holder continuous with respect to t 
on X [0,r]. 

Proof. Lipschitz continuity with respect to x: For fixed y G M'^, v^''\x) = u^^\t,x + y) is the 
solution of a switching system obtained from (|A.ip by replacing with 

r'-'V(^) := ^Tr[af{t,x + y)D^^] +ht{t,x + y)D^ + c'lit^x + y)^ + fr{t,x + y), 

with the terminal condition given by v^^\T,x) = g{T,x + y). By Theorem IA.3t there is a positive 
constant C such that 

|nW(t,x)-n«(t,x + 2/)U = h»(t,x)-t;«(t,x)|oo < C\y\. 

^-Holder continuity with respect to t: For t < s, define u = {u^^^)f£-^ to be the solution to 

max ^-uP - F,{-,u'^'^,Du'^^,D^u^'^),u^^ - M^^u^ =0, fori = !,••• ,M; 

=n«(s,-). 

Since n is a subsolution of (jA.ip on [0, s] x M*^ with terminal condition by comparison 

result, Corollarv IA.41 we have u^^^ < u^^\ Therefore, u^^\t,x) — u^^\s,x) > u^^\t,x) — u^^\s,x). 
By Theorem A.l in [3], n^*^ is ^-Holder continuous in t which provides 

u(^) (t, x) - u^^ (s, x) > -CVT^. 

Now, for fixed y G M'^, define 

^» (t, x) := ^e^(^-*) - y\^ + B{s - t)) + j + B{s - t) + g{s, y), 

where A, B and A are positive constants which will be given later and L is the same as in Assumption 
HJB-S. We will show that for an appropriate choice of A and B, {^l^^'^^)fL^ is a supersolution of 
(jA.ip with terminal condition g{s,x). Then, comparison, Corollarv IA.41 would then imply that 
^(«) < ^(*)_ Therefore, 

nW(t,y)-n«(s,y) < ^(') {t,y) - g{s,y) < ^e^^^''^ B{s - t) + j + B{s - t). 

By setting A = ^ , we have u^^\t,y) — n(*)(s,y) < C\/s — t, where C is a positive constant. 
Therefore, it remains to show that for A and B large enough, we have 

-4'^ - inf £.''''4'\4'^ - M^'^^A ,4''^ -g]>0, 



mm < max 
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on [0, s] X M.^. Since V'^*-* — M^^^ip^^^ < 0, one needs to show that 



-ijf^ - inf > and tp^"^ - g > 0. 



Observe that if i? > 1, by the regularity assumption on g, we have 

i^^'\t,x)-g{t,x) > ^(^X\x-y\^ + X{s-t) + j^+g{s,y)-g{t,x)>0. 
On the other hand, 

-V'f - inf C'"^^'^ = sup J — e^("-*) ( A\x - + AB{s - t) + B 

- ilV [a°'*] - r'' ■{x-y)^+B- c"'>(*) - /°'^| 

> j^^i^ _ y|2 _ _ y| + ^5 _ + s _ 

By choosing A and i? large enough, the right hand side in the above inequality is positive which 
completes the argument. □ 
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